AFRL-RI-RS-TR-2015-012 


ROBOTICS  CHALLENGE:  COGNITIVE  ROBOT  FOR  GENERAL 
MISSIONS 


UNIVERSITY  OF  KANSAS 

JANUARY  2015 

FINAL  TECHNICAL  REPORT 


APPROVED  FOR  PUBLIC  RELEASE;  DISTRIBUTION  UNLIMITED 


STINFO  COPY 


AIR  FORCE  RESEARCH  LABORATORY 
INFORMATION  DIRECTORATE 


■  AIR  FORCE  MATERIEL  COMMAND 


■  UNITED  STATES  AIR  FORCE 


■  ROME,  NY  13441 


NOTICE  AND  SIGNATURE  PAGE 


Using  Government  drawings,  specifications,  or  other  data  included  in  this  document  for  any  purpose 
other  than  Government  procurement  does  not  in  any  way  obligate  the  U.S.  Government.  The  fact  that 
the  Government  formulated  or  supplied  the  drawings,  specifications,  or  other  data  does  not  license  the 
holder  or  any  other  person  or  corporation;  or  convey  any  rights  or  pennission  to  manufacture,  use,  or 
sell  any  patented  invention  that  may  relate  to  them. 

This  report  is  the  result  of  contracted  fundamental  research  deemed  exempt  from  public  affairs  security 
and  policy  review  in  accordance  with  SAF/AQR  memorandum  dated  10  Dec  08  and  AFRL/CA  policy 
clarification  memorandum  dated  16  Jan  09.  This  report  is  available  to  the  general  public,  including 
foreign  nationals.  Copies  may  be  obtained  from  the  Defense  Technical  Information  Center  (DTIC) 
(http://www.dtic.mil). 


AFRL-RI-RS-TR-20 15-012  HAS  BEEN  REVIEWED  AND  IS  APPROVED  FOR  PUBLICATION  IN 
ACCORDANCE  WITH  ASSIGNED  DISTRIBUTION  STATEMENT. 


FOR  THE  DIRECTOR: 


/  s  / 

MICHAEL  J.  WESSING 
Deputy  Chief,  Information  Intelligence 
Systems  and  Analysis  Division 
Infonnation  Directorate 


/  s  / 

PETER  J.  ROCCI 
Work  Unit  Manager 


This  report  is  published  in  the  interest  of  scientific  and  technical  information 
publication  does  not  constitute  the  Government’s  approval  or  disapproval  of  its  ideas 


exchange,  and  its 
or  findings. 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No.  0704-0188 

The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including 
suggestions  for  reducing  this  burden,  to  Department  of  Defense,  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports  (0704-0188),  1215  Jefferson  Davis  Highway, 
Suite  1204,  Arlington,  VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  penalty  for  failing  to  comply  with  a  collection  of 
information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 

1.  REPORT  DATE  (DD-MM-YYYY) 

JANUARY  2015 

2.  REPORT  TYPE 

FINAL  TECHNICAL  REPORT 

3.  DATES  COVERED  (From  -  To) 

SEP  2012 -SEP  2013 

4.  TITLE  AND  SUBTITLE 

ROBOTICS  CHALLENGE:  COGNITIVE  ROBOT  FOR  GENERAL 
MISSIONS 

5a.  CONTRACT  NUMBER 

FA8750-1 2-1 -0302 

5b.  GRANT  NUMBER 

N/A 

5c.  PROGRAM  ELEMENT  NUMBER 

62702E 

6.  AUTHOR(S) 

Dongkyu  Choi 

5d.  PROJECT  NUMBER 

1166 

5e.  TASK  NUMBER 

PR 

5f.  WORK  UNIT  NUMBER 

08 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

University  of  Kansas 

2120  Learned  Hall 

1530  W.  15th  Street 

Lawrence,  KS  66045 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

Air  Force  Research  Laboratory/RIED 

525  Brooks  Road 

Rome  NY  13441-4505 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

AFRL/RI 

11.  SPONSOR/MONITOR’S  REPORT  NUMBER 

AFRL-RI-RS-TR-201 5-01 2 

1 12.  DISTRIBUTION  AVAILABILITY  STATEMENT  it 

Approved  for  Public  Release;  Distribution  Unlimited.  This  report  is  the  result  of  contracted  fundamental  research  deemed 
exempt  from  public  affairs  security  and  policy  review  in  accordance  with  SAF/AQR  memorandum  dated  10  Dec  08  and 
AFRL/CA  policy  clarification  memorandum  dated  16  Jan  09. 

13.  SUPPLEMENTARY  NOTES 


14.  ABSTRACT 

To  operate  properly  in  a  complicated  environment,  a  robotic  system  requires  both  high-level  command  facilities  and  low- 
level  sensing/control  mechanisms.  This  report  describes  a  powerful  combination  of  a  cognitive  architecture  at  the  high- 
level  and  the  whole-body  motion  control  at  the  low-level.  The  team  has  achieved  significant  technical  advances  in 
relation  to  its  robot  control  architecture,  a  remote  operator  station,  and  an  integrated  system  with  proper  movement 
controls. 


15.  SUBJECT  TERMS 

Autonomy,  Supervised  Autonomy,  Robotics,  Cognitive  Architecture 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

18.  NUMBER 

OF  PAGES 

19a.  NAME  OF  RESPONSIBLE  PERSON 

PETER  J.  ROCCI 

a.  REPORT 

U 

b.  ABSTRACT 

U 

c.  THIS  PAGE 

U 

UU 

11 

19b.  TELEPHONE  NUMBER  ( Include  area  code) 

N/A 

Standard  Form  298  (Rev.  8-98) 


Prescribed  by  ANSI  Std.  Z39.18 


Table  of  Contents 


1.0  Summary . 1 

2.0  Introduction . 1 

3.0  Methods,  Assumptions  and  Procedures . 2 

4.0  Results  and  Discussion . 3 

4.1  Major  rewrites  of  IHC  (Humanoid  Control  Architecture) . 4 

4.2  Operator  Station  for  Remote  Autonomous  Control . 4 

4.3  IHC  and  Operator  Station  Integration . 5 

4.4  Stable  Walking  in  VRC  Environments . 5 

4.5  Discussion . 7 

5.0  Conclusions . 7 


List  of  Figures 

Figure  1:  A  Screenshot  of  the  Operator  Station . 5 

Figure  2:  Screenshots  of  the  IHC-Controlled  ATLAS  Robot  Walking . 6 


1.0  Summary 


This  grant  supported  research  and  development  necessary  to  prepare  the  University  of  Kansas 
(KU)  and  the  Korea  Institute  of  Science  and  Technology  (KIST)  team  for  competing  at  the 
DARPA  Robotics  Challenge.  As  a  participant  in  Track  B,  the  team  was  required  to  enter  a 
Virtual  Robotics  Challenge  at  the  end  of  Phase  1  of  this  project.  The  KU-KIST  team  was 
unsuccessful  at  this  event  and  did  not  continue  to  the  next  phase.  However,  the  software  each 
team  member  has  developed  provides  an  excellent  infrastructure  for  future  research  in  robotics 
and  related  fields,  as  detailed  in  this  document. 


2.0  Introduction 

This  final  report  summarizes  outcomes  from  the  project  titled,  Robotics  Challenge:  Cognitive 
Robot  for  General  Missions,1  granted  to  the  University  of  Kansas  (KU)  and  the  Korea  Institute  of 
Science  and  Technology  (KIST).  This  report  is  intended  to  provide  any  interested  researchers  in 
related  fields,  as  well  as  the  funding  agency,  necessary  information  to  measure  the  outcomes  of 
the  project  and  make  informed  decisions  based  on  its  findings  both  positive  and  negative. 

This  project  aimed  to  provide  an  architecture  for  commanding  and  controlling  a  government- 
furnished  equipment  (GFE)  in  the  form  of  a  humanoid  robot  from  Boston  Dynamics  and  its 
simulation.  As  a  participating  team  in  Track  B  of  the  DARPA  Robotics  Challenge,  the 
collaboration  between  the  University  of  Kansas  (KU)  and  the  Korea  Institute  of  Science  and 
Technology  (KIST)  was  intended  to  combine  two  very  distinct  expertise  from  these 
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organizations.  Namely,  the  project  was  designed  to  leverage  on  KIST's  experience  in  designing 
and  developing  control  software  for  humanoid  robots  at  lower  levels  and  KU's  expertise  in 
cognitively  inspired  architectures  for  higher-level,  symbolic  control. 

More  specifically,  researchers  from  KIST  has  extended  their  own  robot  control  architecture 
called  IHC  to  work  with  the  simulated  GFE  robot,  while  the  KU  researchers  has  worked  on 
extending  a  cognitive  architecture  called  ICARUS  for  higher-level  mission  control  and 
developing  interfaces  between  a  variety  of  components  in  the  intended  overall  system. 


3.0  Methods,  Assumptions  and  Procedures 

The  basic  strategy  our  team  has  taken  can  be  summarized  as  a  collaboration  between  KU  and 
KIST  as  two  organizations  with  distinct  expertise.  The  split  of  the  technical  work  was  very  clear, 
in  that  KU  took  responsibility  for  higher-level  mission  command  and  operator  interfaces  while 
KIST  was  in  charge  of  lower-level  control  of  the  robot. 

To  achieve  the  intended  goal  of  this  project,  namely,  developing  a  control  system  for  the  GFE 
robot  in  the  competition  setting,  our  team  has  proposed  to  take  and  extend  existing  software  at 
KU  and  KIST.  Dr.  Choi  at  KU  has  extended  the  ICARUS  cognitive  architecture  he  has  co¬ 
developed  with  his  fonner  colleagues  for  the  purpose  of  this  competition.  Dr.  Kim  at  KIST 
started  with  the  existing  version  of  IHC,  originally  developed  to  control  KIST's  own  Mahru 
humanoid  robots,  and  adapted  it  for  Boston  Dynamics1  ATLAS  robot.  The  operator  interface 
software  was,  however,  developed  from  scratch  by  a  group  of  students  at  KU  under  the 
supervision  of  Dr.  Choi. 
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As  a  basis  for  these  extension  works,  the  team  has  made  a  series  of  technical  assumptions.  The 
KIST  researchers  assumed  that  1)  they  would  have  a  complete  access  to  ATLAS  and  its 
simulation;  2)  the  interface  with  the  simulator  is  flawless;  and  3)  the  IHC  software  is  essentially 
bug- free  and  readily  adaptable  for  the  new  robot.  In  the  mean  time,  people  at  KU  assumed  that  1) 
the  IHC's  low-level  control  is  perfect  <  meaning  that  the  robot  can  perform  basic  maneuvers  like 
walking  without  interventions  from  the  ICARUS  architecture  and  2)  the  competition  rules 
require  continuous  execution  of  tasks  in  a  single  operation  making  it  necessary  to  have  a 
powerful  goal  switching  mechanism  at  the  high  level  of  the  system. 

Based  on  these  assumptions,  the  execution  is  procedurally  straightforward  involving  the  KU- 
developed  operator  station,  the  ICARUS  architecture  with  a  competition-specific  knowledge 
base,  and  KIST's  IHC  all  communicating  over  a  TCP  network.  Then  the  system  would  connect 
to  the  simulated  environment  over  the  competition’s  network  infrastructure. 


4.0  Results  and  Discussion 

Over  the  duration  of  this  project,  the  team  has  made  significant  technical  progress.  Despite  the 
early  tennination  of  the  project  due  to  the  VRC  result,  both  research  groups  at  KU  and  KIST 
have  achieved  the  following: 
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4.1  Major  rewrites  of  IHC  (Humanoid  Control  Architecture) 

As  a  subcontractor  in  the  team,  KIST  entered  the  Robotics  Challenge  with  their  existing  robot 
control  architecture,  IHC.  In  the  past,  the  system  had  proved  to  be  an  excellent  software  for  a 
humanoid  robot,  Mahru,  which  was  built  in-house  at  KIST.  However,  the  architecture  was  not 
previously  used  on  a  different  robot  platfonn  and  had  lacked  the  compatibility  and  stability 
necessary  to  serve  as  an  off-the-shelf  control  system  for  ATLAS  platform  and  its  simulation  on 
Gazebo.  Dr.  Doik  Kim  and  his  student  focused  on  enhancing  the  compatibility  of  IHC  and 
adapting  the  architecture  for  the  purpose  of  the  Robotics  Challenge.  This  process  involved 
rewriting  and  debugging  major  portions  of  the  code. 

4.2  Operator  Station  for  Remote  Autonomous  Control 

Dr.  Choi  and  his  students  at  KU  developed  the  software  for  an  operator  station  that  was  designed 
to  be  a  remote  command  and  control  facility  for  the  ATLAS  platform  (see  Figure  1).  The 
operator  station  acts  as  a  middleware  that  connects  Dr.  Choi’s  ICARUS  cognitive  architecture 
that  receives  sensor  data  and  transmits  command  signals  with  the  robot  platform  at  a  remote 
location.  The  communication  module  in  this  software  was  designed  to  minimize  internet  traffic 
by  acting  as  a  maintainer  of  the  sensory  data  that  are  requested  and  updated  only  when 
specifically  requested  by  ICARUS.  In  the  event  of  communication  delay  or  failure,  ICARUS  was 
able  to  use  slightly-dated,  but  often  still-usable  sensory  data.  The  operator  station  was  developed 
in  a  generic  and  modularized  fashion  to  allow  its  future  usage  with  virtually  any  robotic 
platform. 
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Figure  1:  A  Screenshot  of  the  Operator  Station 


4.3  IHC  and  Operator  Station  Integration 

The  KIST  and  KU  researchers  jointly  worked  on  the  integration  of  IHC  and  the  operator  station. 
Since  IHC  is  written  as  C++  libraries,  the  process  of  integrating  the  two  software  was  relatively 
straightforward.  The  operator  station  is  registered  as  a  module  in  IHC  framework  that  acts  as  a 
wrapper  software  around  ICARUS’s  decision  making  procedures. 

4.4  Stable  Walking  in  VRC  Environments 

The  team  had  initially  experienced  difficulty  in  making  the  ATLAS  robot  to  walk  stably  over 
nontrivial  surfaces.  Through  the  continued  efforts  on  the  KIST  side  even  after  the  VRC  event, 
IHC  successfully  controlled  the  robot  to  walk  on  a  variety  of  surfaces.  Figure  2  shows  a 
simulated  ATLAS  robot  with  IHC’s  control  perfonning  some  of  these  walking  motions. 
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Figure  2:  Screenshots  of  the  IHC-Controlled  ATLAS  Robot  Walking 
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4.5  Discussion 


Despite  the  technical  achievements  outlined  above,  our  team  lacked  the  timely  administrative 
support  from  the  subcontractor  organization.  The  subcontracting  process  was  delayed 
significantly  for  roughly  six  months.  The  PI  had  assumed  that  at  least  some  technical  work 
would  be  done  by  the  subcontractor  during  this  period  although  the  final  subcontract  was  yet  to 
be  signed.  However,  this  did  not  happen  in  reality  and  it  caused  a  serious  shortage  of  time  toward 
the  end  of  Phase  1.  This  was  one  of  the  main  factors  that  resulted  in  the  team’s  undesirable 
outcome  at  the  VRC  event.  Due  to  the  delayed  start  at  KIST,  the  subcontractor  had  underspent  its 
original  budget  and  the  difference  was  transferred  back  to  KU.  With  DARPA  approval,  Dr.  Choi 
used  this  fund  to  facilitate  future  research  in  the  related  direction  as  showcased  in  the  Robotics 
Challenge. 


5.0  Conclusions 

In  summary,  the  KU-KIST  team  had  achieved  significant  technical  advances  in  relation  to  its 
robot  control  architecture,  a  remote  operator  station,  and  an  integrated  system  with  proper 
movement  controls  for  the  ATLAS  robot.  Although  the  administrative  challenges  the  team  had 
encountered  resulted  in  the  eventual  lost  at  the  VRC  event,  the  team  attempted  to  maximize  the 
impact  of  the  resources  granted  by  DARPA  for  current  and  future  research  in  robotics.  The  team 
is  grateful  to  DARPA  for  the  opportunity  to  participate  in  the  exciting  event  and  the  financial 
support  granted  to  the  team. 
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